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Abstract 

Quantum game theory lays a foundation for understanding the interaction of people using 
quantum computers with conflicting interests. Recently Zhang proposed a simple yet rich model 
to study quantum strategic games, and addressed some quantitative questions for general games 
of growing sizes |ZhalO| . However, one fundamental question that the paper did not consider 
is the characterization of quantum correlated equilibria (QCE). In this paper, we answer this 
question by giving a sufficient and necessary condition for an arbitrary state p being a QCE. In 
addition, when the condition fails to hold for some player i, we give an explicit POVM for that 
player to achieve a strictly positive gain. Finally, we give some upper bounds for the maximum 
gain by playing quantum strategies over classical ones, and the bounds are tight for some games. 

1 Introduction 

Game theory studies the interaction of different players with possibly conflicting goals |OR94} 
IFT911 IVNRT07] . Equilibrium is a central solution concept which characterizes the situation that 
no player likes to deviate from the current strategy provided that all other players do not change 
theirs. If each player chooses her strategy from a distribution (on her own strategy space), then the 
joint product distribution is a (mixed) Nash equilibrium if no player has incentive to change her 
distribution. A fundamental theorem by Nash says that any any game with a finite set of strategies 
has at least one Nash equilibrium |Nas51| . 

Aumann |Aum74] gave an important generalization of Nash equilibrium, called correlated equi- 
librium (CE), where a Referee selects a joint strategy s = (s\, . . . , s^) from some distribution p 
and suggested S{ to the i-th player. The joint distribution p is a correlated equilibrium (CE) if no 
player i, when sees only her part Sj, cannot deviate from this suggested strategy to improve her 
expected payoff. The notion of correlated equilibria captures the optimal solution in natural games 
such as the Traffic Light and the Battle of the Sexes ( |VNRT07j . Chapter 1). The set of CE also 
has good mathematical properties, such as being convex, with Nash equilibria being some of the 
vertices of the polytope. Computationally, it is benign for finding the best CE (of any game with 
constant players), measured by any linear function of payoffs, simply by solving a linear program. 
Other example include that a natural learning dynamics can lead to an approximate variant of CE 
( [VNRT07] . Chapter 4), and all CE in a graphical game with n players and log(n) maximum degree 
can be found in polynomial time ( |VNRT07] . Chapter 7). 
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In the quantum world, quantum game theory lays a foundation for understanding the interaction 
of people using quantum computers with conflicting interests. Indeed, quantization of classical 
strategic games have drawn much attention in the past decade. Despite the rapid accumulation of 
literature [EWL99I IBHOlbj O03| IFM [EM lDLX+02al lDLX+02bl IPSWZ07| , the whole picture 
of the area is not as clean as one desires, partially due to controversy in models jBHOlat ICT06] , 
Recently, Zhang proposed a new model which is simpler, arguably more natural, and corresponding 
more precisely to the classical strategic games |ZhalO| ; also see that paper for a review of the 
existing literature under the name of "quantum games". Other than the model, what mainly 
distinguishes that work from previous ones is the generality of the classical game it studies: Unlike 
previous work focusing on specific games of small sizes or refereed extensive games, the paper studies 
general strategic games of growing sizes. In addition, rather than aiming at qualitative questions 
such as whether playing quantum strategies has any advantage as in previous work, [ZhalO] studies 
quantitative questions such as how much quantum advantage can a general-sized game have. 

Solution concepts such as Nash equilibrium and correlated equilibrium are naturally extended 
to the quantum model in [ZhalOj . and it is studied how well standard maps between classical 
and quantum states preserves equilibrium properties. It turns out that if p is a classical Nash 
equilibrium, then both p = 'Yl s p{s)\s){s\ an d 1^) = XL \/p( s )\ s ) are quantum Nash equilibria. 
But correlated equilibrium is of a different story: While p = ^2 s p(s)\s)(s\ is still guaranteed 
to be a quantum correlated equilibrium if p is a classical correlated equilibrium, the mapping 
of p i — y \tp) = y/p(s)\s) can severely destroy the correlated equilibrium property. Therefore, 
correlated equilibrium is a subtler subject to study. 

Given the importance of correlated equilibrium in game theory and computer science, it is 
desirable to well understand quantum correlated equilibria. One fundamental question that |ZhalO] 
did not address is the following: For an arbitrary (classical) strategic game, can we characterize all 
the quantum correlated equilibria (QCE) in the quantum game? 

In this paper, we answer this question by giving the following sufficient and necessary condition 
for any given game and any state p. 

Theorem 1 A quantum state p in space H is a QCE if and only if for each player t, when we 
write p = [p l J \ l j 2 ]i 1 j 1 ,i 2 j2> where i±,i2 £ [m] = {1, 2, ...,m} and 6 [n] with m = dim(H t ) and 

n = dim(H-t), we have 



We first show that the condition is sufficient by working out the gain of the POVM {Ei} as 
^2 i tr(E{Bi), and then give two different proofs for the necessity part. The first one is based on 
semi-definite program, which is simple yet not intuitive enough. The second proof is constructive, 
which shows that when the condition fails to hold for some player i, one can find an explicit POVM 
for that player to achieve a strictly positive gain. Finally, for those cases that are not QCE, we 
give some upper bounds for the maximum gain, which are shown to be tight for some games. 

The paper is organized as follows. Some preliminary knowledge is introduced in Section [2j In 
Section [3] we give the sufficient and necessary condition, and in Section d] the necessity part is 
reproved constructively, which can be regarded as the operational explanation of this condition. In 
Section G2 we obtain some upper bounds of the gain when p is not a QCE. Some open problems 
are listed in Section [6J 
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2 Definitions and notation 



A matrix A G £, nxn is a Hermitian if = A, or equivalently, A has a spectral decomposition 
and all eigenvalues are real numbers. A matrix A G C nxn is a positive (semi-definite), written 
as A y 0, if > for all column vectors \tp). Equivalently, A y if and only if A has a 

spectral decomposition and all eigenvalues are nonnegative numbers. Thus all positive matrices are 
Hermitians. Define A ^ if —A y 0. 

2.1 Classical strategic games 

Suppose that in a classical game there are k players. Each player i has a set Si of strategies. To 
play the game, each player % selects a strategy S{ from Si. We use s = (s±, . . . , s&) to denote the 
joint strategy selected by the players and S = S\ x . . . x S/. to denote the set of all possible joint 
strategies. Each player i has a utility function m : S — > M, specifying the payoff or utility Ui(s) 
to player i on the joint strategy s. We use subscript — i to denote the set [k] — {i}, so is 

(si, . . . , Sj_l, Si+l, . . • , Sfc). 

Definition 1 vl pure Nash equilibrium is a joint strategy s = (si, . . . , s^) G S satisfying that 

Ui(si,s-i) > Ui(s'i,s-i), Mi G [k],\/s'i G S^ 

A (mixed) Nash equilibrium (NE) is a product probability distribution p = p\ x . . . X p^, where each 
Pi is a probability distributions over Si, satisfying that 

^p_i(s_i)?ii(si,s„i) > y^p-i(s-i)ui(s'i, s-j), Mi G [k], Vs;,s- G Si with pi(si) > 0. 

There are various extensions of (mixed) Nash equilibria. Aumann |Aum74j introduced a relax- 
ation called correlated equilibrium. This notion assumes an external party, called Referee, to draw 
a joint strategy s = (si, from some probability distribution p over S, possibly correlated 

in an arbitrary way, and to suggest Sj to Player i. Note that Player i only sees Si, thus the rest 
strategy s-i is a random variable over S-i distributed according to the conditional distribution 
p\ Si , the distribution p conditioned on the i-th. part being Sj. Now p is a correlated equilibrium if 
any Player i, upon receiving a suggested strategy Sj, has no incentive to change her strategy to a 
different s^ G Si, assuming that all other players stick to their received suggestion s_j. 

Definition 2 A correlated equilibrium (CE) is a probability distribution p over S satisfying that 

} j p(s i ,s-i)ui(si,s-i) > y]p(sj, s-i)ui(s'i, s-i), Mi G [k], Vsj,s- G Si. 

Notice that a correlated equilibrium p is an Nash equilibrium if p is a product distribution. 

2.2 Quantum strategic games 

In this paper we consider quantum games which allows the players to use strategies quantum 
mechanically. We assume the basic background of quantum computing; see [NCOOj and [Wat08] 
for comprehensive introductions. The set of admissible super operators, or equivalently the set of 
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completely positive and trace preserving (CPTP) maps, of density matrices in Hilbert spaces Ha 
to H B , is denoted by CPJP(H A ,H B ). We write CPTP(tf) for CPJP(H,H). 

For a strategic game being played quantumly, each player i has a Hilbert space Hi = span{si : 
Si G Si}, and a joint strategy can be any quantum state p in H = ®- L Hi. The players are supposed 
to measure the state p in the computational basis, giving a distribution over the set S of classical 
joint strategies, and yielding a payoff for each player. Therefore the (expected) payoff for player i 
on joint strategy p is 

Ui(p) = ^2( s \p\ s )ui(*)- ( 2 ) 

s 

Please refer to |ZhalO| for more explanations of the model. 

Corresponding to changing strategies in a classical game, now each player i can apply an ar- 
bitrary CPTP operation on Hi. So the natural requirement for a state being a quantum Nash 
equilibrium is that each player cannot gain by applying any admissible operation on her strat- 
egy space. The concepts of quantum Nash equilibrium, and quantum correlated equilibrium, and 
quantum approximate equilibrium are defined in the following, where we overload the notation by 
writing <£j for 3>j ® i_j if no confusion is caused. 

Definition 3 A quantum Nash equilibrium (QNE) is a quantum strategy p = p\ • • • <g> p^ for 

some mixed states pi 's on Hi 's satisfying that 

Ui(p) > Ui($i(p)), Vt G [k], V$i G CPTP(F i ). 

Definition 4 A quantum correlated equilibrium (QCE) is a quantum strategy p in H satisfying 
that 

udfi) > Ui($i(p)), Vi G [k], V$i G CPTP(fii). 

An e-approximate quantum correlated equilibrium (e-QCE) is a quantum strategy p in H satisfying 
that 

Ui(<S>i(p)) < Ui(p) + e, Mi G [fc],V$i G CPTP(^). 

When we later characterize quantum correlated equilibrium, we will need that no player can 
increase her payoff, so a condition is required for each player. For easy presentation, we fix an 
arbitrary player, say, Player 1, and consider the possible increase of her payoff by local operations. 
Write the state as 

o = \p ili2 ] 

where ii,i2 G H\ and G H—\. Suppose that the dimensions of H\ and H^\ are m and n, 

respectively. 

3 Characterization of quantum correlated equilibrium 

We will first give an explicit expression of the gain of Player 1 applying the POVM {Ei} (compared 
to the measurement in the computational basis). 
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Lemma 2 Suppose Player 1 uses the POVM measurement E = {E{\ and other players use M = 
to measure their parts in the computational basis, then the gain of Player 1 by applying E 
than measuring in the computational basis is 



Gain = Ul ((E M)p) - Ul (p) = ^ tr(EiBi), where B { = \ J2 P% 



■jj 2 {o-ij a iiji 



l\%2 



Proof The probability of getting is tr((Ei ® \j)(j\)p) = E h ,i 2 E i (i 1 ,i 2 Y >}f ! . Note that 

J2 ^Wuhr/ffiav = E(E E i(^r)pT a id = E /tfv; = E ( 3 ) 



where the second equality is because being a POVM measurement, {Ei} satisfies £V Ei(ji, i 2 ) = 
Si lt i 2 . Therefore, 

Gavn = E ( E E SiM*PT ~ P%) ^ (4) 

ij ii,i 2 

EE Eiih^yfifoii -EE Either p% 2 (5) 

ij 11,12 ij ii,»2 

= E E EiM)* E " ( 6 ) 

i n,«2 j 

i i 

□ 

The above lemma immediate gives a sufficient condition for a state p being a QCE. 

Theorem 3 If for each player, the corresponding Bi < /or all i G [m], i/ien p is a QCE. 

Proof By the above lemma, the gain Y2i tr(EiBi) < because each Bi -< and each Ei >z 0. 
Since this holds for all possible POVM {Ei}, p is a QCE by definition. □ 

Next we will use SDP duality to show that the condition is also necessary. 

Theorem 4 Suppose p is a QCE, then for each player t, when we write p = [p l J \ J \ 2 ]i 1 j 1 ,i2j2> where 
i±,t2 G [m] and j\,]2 G [n] with m = dim{H t ) and n = dim(H_ t ), we have 



Bi = \ ^2 Pjj 2 (°ij " a hj )} . , =< 0, Vi G [m] . (8) 

j 



Proof Since p is a QCE, Player t cannot increase her payoff by applying any POVM. Therefore, 
the value of the following maximization problem 

max tr{EiBi) 

i 

s.t. Ei ^ 0, Vi G [m], 
m 

^ i = 

i=l 
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is equal to 0. The dual of the SDP is the following. 



Dual: 



min tr(Y) 
s.t. Y >z Bi, Mi G [m] 



Note that Y(i,i) > Bi(i,i) = 0, so the optimal value being implies that all Y(i,i) = Bi(i,i) = 0. 
But Y — Bi y 0, so actually the i-th row of Y — Bi is all 0. Since the i-th row of Bi is 0, so the 
i-th row of Yi is 0. Thus the entire Y = 0, giving the claimed relation Bi ^ 0. □ 

Since a negative matrix is a Hermitian, an immediate corollary is as follows. Why this corollary 
is valid has an operational explanation, which will be shown in the next section. 

Corollary 5 If p is a QCE, then 



Both necessary conditions in Theorem 0] and the above corollary are not constructive in the sense 
that if p is not a QCE, they do not provide an explicit POVM to realize a strictly positive gain of 
payoff. We will resolve this issue in the next section. 

4 A constructive proof of the characterization 

In last section, we give two necessary conditions Eq. (JSj) and Eq. ([9]), the first of which is also 
sufficient (while the second is not by itself). In this section, we will give explicit local operations 
to increase the payoff if these conditions are not satisfied. We will first study in Section 14.11 the 
scenario that Eq. ([9]) is violated, in which case a local unitary operation is explicitly given to achieve 
a positive gain. Based on this result, we will then consider in Section 14.21 the general scenario of 
Eq. ((HI) being violated, in which case we will exhibit an explicit POVM with a positive gain for the 
player. 

4.1 Eq. (jnj) violated: gain by an explicit local unitary 

Lemma 6 If j P % jj 2 a hj 7^ Yl j P % jj' ' a i%j f or some £ [m], then there exists an explicit unitary 
only on span{\i\), ^2)} to make an increase of payoff for the player. 

Proof Consider the unitary operator U defined by 



The new probability distribution of strategy after the operation of W on span{\i\), ^2)} and identity 
on other i's is 




(9) 



U\h) = un\h) + U12K2), 
U\i 2 ) = u 2 i\k) + n 22 |i2)- 



Pij = Tr((U\i)(i\tf®\j)(j\)p). 



(10) 
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where we overload the notation by writing U for U <8> ^[m]-{ii,i 2 }- Note that when i £ [m] — {11,12}, 
Pij = Tr(\i)(i\ <g) |i)(i|)p) = pjj- Thus, the gain of Player 1 by the operation ^ is 



Gain 



Pjj ) CLij 



E (wj 

E (Piii ~ f'jj"')"' ' + E (P*ai 



E ( E ^"Uui 

j a,6=l 



+ E ( E pt^. 

j a,b=l 



*b P?j 2 ) 



E [\un\ 2 P^ 1 +n* u u 12 p^ +u llU * 12 p^ + \u 12 \ 2 p 
j 

+ E (^Pjj 1 + «Wp}f + +\u 22 \ 2 pf! 



12*2 _ IHI . . 
£77 / 



,«2*2 „ l 2«2 



Since U is a unitary operation, we have 

UuUl2 + U 21 U22 = 0, nii«* 2 + ^21^22 = 0, 



and 

Thus, we obtain 

Gain 



l^lll 2 + l^ll 2 = 1, 1 1*12 1 2 + |«22| 2 = 1. 



^n^E 



)p)T + nnn i2 E ~ a w)p 



>d 2 E i ^' ~ a ^i)p)T 



%2%\ 
jj 



i u 2i i 2 E ( ai ij ~ ai ^)p)T 



(ii) 

(12) 



Since EjKij ~ a i2j)pfj 2 ^ °> we nave Ej( a *ij ~ " ; -j Pj',' ' = Ej( a nj ~ a i2j)(pfj 2 )* / as well. 
Define a positive real number c by 



max • 




^°«2j a «lj^ 


Pfj\^j{ a *d-^2j) 


pT} 




Y^j (^iij a i23 


pT 





which is just to make 



and 



Oijj - ai 2 j)P l jj 1 < c E l^ii ~ ai ^)P)T 



Now one could choose tin = y/1 — x, and U12 = e tr y/x, where x is a positive real number, and r is 
a proper real number such that u\]U\2 Yj( a hj ~ a i2j)p l jj 2 1S a l so a positive real number. It can be 
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checked that if < x < ^xj, we have 



I "12 1 



1 — X 



> c, 



which implies 



Gain = 2\un\ • |ui 2 | y~] (a^j - <n /: j)p'jj 



j 

\uu\ 2 Y^ ( a hj ~ a hj)p l jj 2 ~ l«21 1 2 ~ a i2j)p, 

j j 



jj 



> 0. 



□ 



4.2 Eq. ([8]) violated: gain by an explicit POVM 

In the rest of this section, we assume that condition Eq. ([9]) holds, because otherwise there exists 
explicit local unitary operation to increase the payoff. 



First note that under this assumption, all matrices Bi 
Indeed, we have 

i^2,ii)* = I>^T(%-a^) 
j 

j 

= J2p l jj 2 ( a V- a nj) 



EjpT^. 



are Hermitians. 



(because Ojj,Oj 2 j £ 



(because p is Hermitian) 



(by Eq. ©) 



(13) 



(14) 



(15) 



Therefore all B^s have spectral decompositions. 

Now suppose that Bi H is not true for some i S [m]. Without loss of generality, assume that 
i = 1, namely B\ has a positive eigenvalue. We denote it by A, and the corresponding eigenvector 
(with unit £2 norm) is \ ip). Note that the first row contains all 0's, and since we assumed Eq. ([9]), so is 
the first column. This allows us to write \tp) = (0, 1)2, v 3 , ...,v m ) T for some V{S. For the convenience 
of our discussion, we suppose |t>2| 7^ 0. Otherwise, since (4>\Bi\(j)) is a continuous function of \4>), 
one can always perturb a little to get another vector \ip') such that A' = (ip'\Bi\ip') > and the 
second entry of is not (while still keeping the first entry being 0). Then we replace and 
A by \ifj') and A' in the following argument. 

In the following, we will construct a local POVM {Ei} by which Player 1 can strictly increase 
her payoff, which will complete the proof. Set {Ei} to be 



E 1 = e\^){^\ + \1){1\ 



A 









2 



e\V2 

EV2*V 3 



\0 ev\v m ev^v r , 



\ 

£V 2 V* 

ev 3 v* 



e\v r , 



(16) 



S 










d 22 
-SV2 f 3 





-£V 2 V^ 
d-23 



\0 — ei^Um 



\ 

-ev 2 v* 


d2,m / 



(17) 



E. 



m—l 














\ 























^33 


-ev 3 v% ■ 


• • -e^3< 








— SV^Vi 


dzA 










-evlv m 





^3,m / 




(° 


... 





\ 







... 













... 


dm—l,m—l 


£V m —\V m 




^0 


... 




dm—l,m / 



(18) 



(19) 



E,, 






Vo 



00 \ 



(20) 





d mm J 

Here, e is a small positive number that will be determined later. For any fixed e, we will choose 
dij's as follows. Firstly, note that we have the relationship 



E x +E 2 + ...+E„ 



(21) 



by which one can obtain that d 22 = 1 — e|^2| 2 - Let d 2k = (£\v2Vk\) 2 /d 22 , thus d 2 ±d 2 k = (£\v 2 Vk\) 2 
and E 2 >z 0. After fixing E 2 , can also be gotten by using J2i Ei = I. In general, we have 

1 - e\vi\ 2 - d 2 ,i di-ij, Vi > 3, (22) 

e 2 \viV k \ 2 /du, Vi>2, k>i + l (23) 

By an induction on i, it is not difficult to see that for any fixed -Bj's, for e — > 0, it holds that 



da ■ 
dik 



di 



1 -e\vi\ 2 - 0(e 2 ) = 1 - 0(e) > 0, Vi > 2 



(24) 



and 



d ik = e 2 \v l v k \ 2 /d ll = 0(e 2 ), Vi > 2, Vfc > i + 1. (25) 

It can be checked that E\ = e\ijj)(ifj\ + |1)(1| ^ 0, and every other £7j is also positive because it has 
nonnegative diagonal entries and is actually diagonally dominant Hermitian for sufficiently small 
e. Besides, since the way we defined {E{\ satisfies ^^Ei = I, {Ei} is a legal POVM. 
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Next we calculate the gain of the Player by using {Ei} as in Lemma[2j Since (i/j\Bi\i/j) = A, we 
have 

Tr(E\B\) = <l|Bi|l) + WBxty) = (Vl^il^) = eA. (26) 

For i = 2, m, note that the only nonzero off-diagonal entries of Ei are on the i-th row and 
column, but those entries in Bi are zero. So only the diagonal entries of Ei and Bi contribute to 
Tr(Ej Bi), and the contribution is YlT^^i^i^j Pjj( a ij ~ a kj))- Therefore, 

m m 

Gain = Tr(E t Bi) = e\ + J2Yl d ^ k ( ~ ak ^) ( 27 ) 

i i=2 k=i j 

m m 

= e\ + Y^ <k,k ( Pjj( a iJ ~ a kj)) (because Bt(i, i) = 0) (28) 

i=2 k=i+l j 

= eX±0(e 2 ) (because of Eq. (12511) (29) 

Here note that m and Bi are all fixed and only e approaches to 0. So for sufficiently small e, the 
gain is strictly positive. 

5 Upper bounds for the gain 

In the above sections, we have shown how to determine whether a given quantum state is a QCE 
or not. In this section, we consider those quantum states that are not QCE. According to the 
definition of QCE, one can find a proper POVM {Ei} such that some player can get a strictly 
positive payoff gain by this operation. A natural question is, how much is the maximal gain? In 
the following theorem we provide two simple upper bounds as first-step attempts. 

Theorem 7 Suppose that the maximum eigenvalue of Bi = [ ^ ■ pjj 2 (ay — a iij)]i li2 ^ s -V Let 
A = maxj Aj, then we have 

Gain < mX. (30) 
Proof Since Bi ^ Xil and each Ei is positive, it holds that 

Tr(EiBi) < Tr(E t (XJ)) = XiTr(Ei). 



Thus, 



Gain = J2Tr(EiBi) (31) 

i 

< ]T \iTr(Ei) (32) 

i 

< X^TrlEi) (Tr(Ei)>0) (33) 

i 

= mX (£2 Tr ( E i) = Tr (Yl E ^ = m )- ( 34 ) 



□ 



Another bound is the following. 
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Theorem 8 Suppose that the eigenvalues of Bi = [Ylj Pjj 2 ( a ij ~ a hj)]i j 2 * s Ki, Km- Then 

Gain < Ay. (35) 

ij:\ij>0 

Proof Suppose the spectral decomposition of Bi is B[ = X^efm] ^ijl^ij) (V'ijl- Then 
Gam = ^Tr 



i j&[m] 
ij:\ij>0 

< E A « 

ij:A i;) >0 



((ipijlEMij) < (tpijillipij) = 1) 



(36) 
(37) 

(38) 

(39) 



□ 



The above bounds can be pretty tight. By the dual SDP, it is not hard to see that the gain is 
the following value: 

min tr(Y) 

s.t. Y y Bi, Vi E H 

Consider the following example: 



1 ... i 
,0 •■■ 

Ui 



••• 



i 

mn 



1 

trm. 



mnxmn 



It is not hard to verify that 

B\ = diag(0, 1/m, 1/m), i?2 



£? m = diag(-l/m, 0, 0). 



Therefore, the gain is tr(Bi) = (m — l)/m, which matches the second bound, and is also close to 
the first bound 1. 



6 Open problems 

Some open problems are left for future explorations. 

1. In Section 4, we show that if the condition is not satisfied for Player i, the player can use a 
POVM to obtain a strictly positive gain. A natural questions is, can the POVM be replaced 
by a unitary operation? In general, can the maximum gain always be achieved by a unitary 
operation? 
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2. Can the condition be simplified if p is a pure state? 

3. How to improve the bounds in Section [5f 

4. Can we have a nice characterization of e-approximate QCE? (Results in Section [5] provide 
sufficient conditions for e-QCE, where the e is the one of the given upper bounds. We hope 
to say more.) 
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